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Abstract —In this paper, we propose a new robust analysis 
tool motivated by large-scale systems. The Hoo norm of a system 
measures its robustness by quantifying the worst-case behavior 
of a system perturbed by a unit-energy disturbance. However, 
the disturbance that induces such worst-case behavior requires 
perfect coordination among all disturbance channels. Given 
that many systems of interest, such as the power grid, the 
internet and automated vehicle platoons, are large-scale and 
spatially distributed, such coordination may not be possible, 
and hence the Hoo norm, used as a measure of robustness, 
may be too conservative. We therefore propose a cardinality 
constrained variant of the Hoo norm in which an adversarial 
disturbance can use only a limited number of channels. As this 
problem is inherently combinatorial, we present a semidefinite 
programming (SDP) relaxation based on the £1 norm that 
yields an upper bound on the cardinality constrained robustness 
problem. We further propose a simple rounding heuristic based 
on the optimal solution of SDP relaxation which provides a 
lower bound. Motivated by privacy in large-scale systems, we 
also extend these relaxations to computing the minimum gain of 
a system subject to a limited number of inputs. Finally, we also 
present a SDP based optimal controller synthesis method for 
minimizing the SDP relaxation of our novel robustness measure. 
The effectiveness of our semidefinite relaxation is demonstrated 
through numerical examples. 

I. Introduction 

Structure, and in particular sparsity, has proven to be a 
powerful tool in the analysis and design of large-scale con¬ 
trol systems. Lyapunov analysis [1], distributed performance 
certification [2], distributed optimal controller synthesis [3] 
and controller architecture design [4] all rely on and ex¬ 
ploit structural properties of the underlying system to solve 
seemingly intractable problems in a computationally efficient 
manner. In contrast, in the context of robust control, adding 
additional structure to system uncertainty has traditionally 
made analysis and synthesis more difficult. For instance, 
linear matrix inequality (LMI) based necessary and sufficient 
conditions for the robust stability of a system subject to an 
unstructured delta block can be derived, but no such results 
exist if we restrict ourselves to highly structured delta blocks 

[5]. 

In this paper, we ask the following question, which we 
later interpret in terms of robustness to structured distur¬ 
bances: given a large scale system with p input channels, 
what fc <C p input channels should be used to maximally 
(minimally) perturb the system using an unit energy input. 
We show that the solution can be obtained by suitably 
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modifying the power semi-norm based definition of the Hoo 
norm of a system to incorporate a cardinality constraint on 
the input; we therefore call the resulting performance metric 
the fc-sparse Hoo norm of the system. 

We argue that questions pertaining to the maximal and 
minimal gains of a system restricted to a sparse subset of 
inputs arise naturally in the context of distributed system 
robustness analysis, consensus robustness analysis, privacy 
and system security. We further show that the resulting 
optimization problems are in fact a generalization of the 
maximal and minimal sparse eigenvalue problems, objects 
of central importance in certifying the performance of com¬ 
pressed sensing matrices [6] and in sparse PC A [7], We 
also show touch upon how these restricted gains relate to 
analogous conditions developed in the Regularization for 
Design (RFD) [4] framework that guarantee the recovery of 
optimal controller architectures. 

Of course, the resulting optimization problems are combi¬ 
natorial in nature, and are easily seen to be computationally 
difficult in general. Leveraging a novel primal formulation 
of the KYP lemma [8], we propose a semidefinite relaxation 
(akin to that proposed in [7]) for computing lower/upper 
bounds on the resulting minimal/maximal restricted gains 
of the system, and a simple rounding heuristic to obtain 
corresponding upper/lower bounds. We further derive the 
dual of the resulting semidefinite program (SDP) and show 
that it has similar structure to the traditional KYP LMI 
test, allowing for standard semidefinite programming based 
controller synthesis methods to be applied. 

The paper is organized as follows: in Section II, we 
formally introduce the fc-sparse Hoo norm and the analo¬ 
gous fc-sparse minimal gain of a system, and elucidate on 
several engineering applications. We also make connections 
to compressed sensing, restricted isometry constants and 
sparse PCA, as well as RFD. In Section III we present 
both a semidefinite relaxation and a rounding heuristic to 
obtain lower and upper bounds on the fc-sparse Hoo norm 
of a system. The dual to our semidefinite relaxation is 
derived in Section IV, and we show how it can be used 
to synthesize a centralized controller that minimizes the 
relaxed fc-sparse Hoo norm of the system. We present several 
numerical examples in Section V, and end with a summary 
and discussion of future directions in Section VI. 

A. Notation 

We use IZHoo to denote the space of stable real-rational 
proper transfer matrices. We use lower case Latin letters 
x to denote vectors, bold lower case Latin letters x to 
denote signals, upper case Latin letters X to denote matrices 


and upper case calligraphic letters X to denote elements of 

'R-'Hoo- 

We recall the definition of the power semi-norm, ||x||p := 
lim ~k zCfcio 1 x k x k■ F° r a matrix A', we denote its con¬ 
jugate transpose by A'*, transpose by A T , the projection 
of X onto its diagonal elements by diag(A), and the 
range space and the null space of X by Range (X) and 
Ker(A) respectively. In addition, |X| denotes the element¬ 
wise absolute value of A, and the one vector 1 is a vector 
whose entires are all one. The generalized inequality X A 0 
means that X is positive semidefinite, and X >- 0 means 
that A is positive definite. 

II. fc-SPARSE 'Hoo ANALYSIS 

We consider a discrete time linear time invariant system^] 

M(z) = C{zI-A)~ 1 B + De HUoo. ( 1 ) 

Recall that the Hoo norm of Ad can be computed as the 
worst case gain in the output of the system induced by a 
disturbance of unit power semi-norm [9], [10], [8]: 

ll-MII^, :=maximize ||Cx + Dw\\ 2 P 

W,X 

subject to Xk+i = Axk + Bwk 
x 0 = 0 

ll w llp < 1- 

The T-Lao norm measures the worst-case behavior of the 
system subject to power semi-norm bounded disturbances, 
and it has well known implications on the robust stability 
of the system with uncertain blocks [5], as well as many 
practical interpretations [9]. 

One such interpretation is that an attacker seeks to max¬ 
imize their disruption of the system using the disturbance 
w - in this case, the optimal disturbance w* to optimiza¬ 
tion problem (0 is precisely a disturbance that maximizes 
the attacker’s impact on the system. Taking an opposite 
perspective, from the viewpoint of a system designer, the 
maximizing disturbance denotes a weak point of the system 
that may need to be addressed. 

A seemingly innocuous assumption in the above analysis 
is that the attacker can simultaneously coordinate all of the 
disturbance channels: although reasonable in a centralized 
setting, this assumption may prove to be quite conservative 
when Ad is a distributed system. In particular, if there are 
many possible disturbances (B has many columns), and 
these disturbances enter through channels that are physically 
separated, it may be overly conservative to consider the 
response of the system to a centralized attack. In order 
to alleviate this conservativeness, we propose a cardinality 
constrained variation of optimization problem 0, in which 
we assume that at most k disturbance channels can have 

1 Although we present our analysis for discrete-time systems, analogous 
arguments and results hold for continuous time systems. 


non-zero power semi-normfl 

{fik (Ad)} 2 := maximize ||Cx + Dw||p 

W,X 

subject to Xk+i = Axk + Bwk 

Xo = 0 ( 3 ) 

||w||p < 1 
Card (w) < k. 

We refer to (Ad) as the fc-sparse T-Loo norm of system Ad. 

It should be clear that /ife (Ad) < HAdHoo for all k, 
but the size of the difference between those two quantities 
is unclear. If the gap is small, then the additional effort 
needed to accommodate the cardinality constraint on the 
disturbance may not be justified. Before elaborating on other 
interpretations of the fc-sparse 7d- x , norm of a system, we 
show that the gap between fik (•) and || • Hoc can be made 
arbitrarily large for a fixed k by letting the state dimension 
of the underlying system tend to infinity. 

Example 1: Consider a system Ad, as in 0, described 
by state-space parameters (A, B,C, D), where A = 
0’.99ill T + 0.1(J„ - iH T ) € R” xn , B = I n , C = I n , 
D = 0 n , n - Due to the special structure of the state-space 
parameters, optimization problems © and © can be solved 

analytically, and = O Thus for a fixed k the 

gap between fik (Ad) and HAdjloo can be made arbitrarily 
large by letting n —> oo. Figure Q] shows j f or ^ = ^ 
and n = 5,... ,30. 


5-sparse H infinity 



Fig. 1: The ratio, /U 5 (Ad)/||Ad|| 00 for n = 5, • • • , 30. 


Example [T] shows the existence of systems for which 
standard Hoo analysis can be overly conservative if indeed 
only at most k disturbances can be expected to coordinate 
their efforts to disrupt the system. We now outline two 
concrete engineering applications in which such an analysis 
may arise. 

Robustness analysis for distributed system: Quantifying 
the robustness of a distributed system, such as the power grid, 
allows the system designer to plan for and mitigate the worst 
case effects of un-modeled dynamics and disturbances. The 

’ We define the cardinality of a power signal. Card (w) as the number of 
indices i such that ||wj||p > 0. Notice that because we use the power semi¬ 
norm in this definition, all signals with finite £2 norm have a cardinality of 
0, as their power semi-norm is 0. 





need for robustness is increasingly important in the context 
of the power grid as it becomes more reliant on intermittent 
distributed energy resources, such as renewables. However, 
as mentioned, Boo analysis assumes that all such distributed 
energy resources coordinate with each other to destabilize 
the power network, which may be overly conservative and 
lead to loss of efficiency. Rather, we propose using the fc- 
sparse Boo norm of the system to identify and quantify 
vulnerabilities of the system to potentially more realistic 
disturbances. 

Robustness analysis for consensus network: The well 
studied problem of consensus (or synchronization) [ 11 ], [ 12 ], 
[13] is one in which a set of agents seek to converge to 
a common value using simple local averaging rules. When 
these local rules are linear and time invariant, the consensus 
protocol can be modeled as an LTI system. In this case, a 
system dynamics A satisfies the following properties [14]: 
A 1 = 1 , A T 1 = 1 , and p(A — ill T ) < 1, where n is the 
number of nodes in the network. 

Although typically considered in a disturbance free set¬ 
ting, it is also natural to ask how much local disturbances 
applied to individual agents can affect the system’s ability to 
reach consensus. Concretely, assume that each agent can be 
corrupted by a separate disturbance, i.e., that B = /„, and 
we measure the effect of the disturbances on the deviation 
of each state x J k from the consensus value, as encoded by 

4 = 4 - n E,. 4’ such that C = I n - ill T , and D = 0. 

Note that the marginally stable mode of A is unobservable 
with respect to the measured output defined by C, and the 
system has a finite B x norm and fc-sparse Boo norm. 

Whereas the Boo norm of the resulting system measures 
the effects of a worst-case attack on all agents, the fc-sparse 
Boo norm measures the effects of worst-case attack on only 
k agents. From an attacker’s perspective, this may result in a 
more realistically implementable strategy, and from a system 
designer’s perspective, this provides valuable information 
as to which agents should be most closely monitored and 
protected from attack. 

A. The k-sparse minimal gain of a system 

We can also define the minimal /.'-sparse gain of system 
A4, which we denote by p (Af) as 

{p {M)} 2 := minimize ||Cx + Dw\\ 2 p 

—k W,X 

subject to Xk+i = Ax-k + Bvtk 

Xq = 0 ( 4 ) 

l|w||p > 1 
Card (w) < k. 

Privacy: An immediate interpretation of this optimization 
problem is in terms of privacy. Suppose that a publicly 
available variable is defined by Zk = Cxk, and that a 
user wishes to transfer at least 7 units of power to yk = 
Gxk + Hwk while minimizing their effect on the public 
variable. The optimal action for the user to take can be 
determined by solving optimization problem 0 with the 


added constraint 

||Gx + ifw||p > 7 2 (5) 

System security: One can also view the user in the above 
scenario as an attacker, and the publicly available variable 
as a system monitor: in this case, the optimal input w, 
corresponds to the least detectable input that still disrupts the 
output y by 7 units of power. Allowing for sparse optimal 
inputs w* makes for more realistically implementable actions 
by either a user or an attacker. 

B. Connections to the Restricted Isometry Property and 
Regularization for Design 

Our problem formulation seeks the minimal and maximal 
gains of a linear operator restricted to fc-sparse subspaces. 
When the linear operator is a static matrix D, instead of a 
dynamical system (A = B = C = 0), then the cardinality 
constrained optimization problems ( 0 ) and 0 compute pre¬ 
cisely the maximal and minimal restricted eigenvalues [15] 
of the matrix D T D, that is the maximal and minimal gains 
of D restricted to sparse subspaces. They are also closely 
linked to the Restricted Isometry Property (RIP) constant of 
the matrix, which can be used to state conditions for the 
recovery of sparse vectors [ 6 ] via convex optimization, and 
can be used to perform sparse principal component analysis 
(sPCA) [7]. We can therefore view optimization problem (0 
as a tool for bounding the restricted eigenvalues of an infinite 
dimensional LTI operator acting on signals in £ 2 - 

Moreover, the fc-sparse Boo norm and the fc-sparse min¬ 
imal gain of a system also have natural connections to the 
Regularization for Design (RFD) framework developed in 
[4]. In the RFD framework, atomic norms [16] are added 
as convex penalties to traditional model matching problems 
in order to design architecturally simple controllers. Further, 
control theoretic analogs to the recovery conditions found 
in the structured inference literature are stated in terms of 
restricted gains that are closely related to the fc-sparse Boo 
norm and fc-sparse minimal gain of a system - we are cur¬ 
rently actively exploring the application of the computational 
methods developed in this paper to computing bounds on 
these restricted gains. 

III. SDP RELAXATION OF fc-SPARSE Boo ANALYSIS 

As posed, optimization problems 0 and 0 are in¬ 
tractable: the optimization variables are infinite dimensional, 
and the cardinality constraint introduces a combinatorial 
aspect to the problem. In order to develop a computationally 
tractable framework, we propose an SDP based convex 
relaxation of the fc-sparse Boo norm 0 and the fc-sparse 
minimal gain ©. We begin by reviewing recent results on 
traditional Boo analysis [ 8 ], [17]. 


A. Review of Boo analysis 

From previous work [ 8 ], [17], we know that using a matrix 



k—0 


Xk 


Xk 

_Wk_ 


W k 


h0, 






the optimization (J2J can be transformed to the following 
equivalent finite dimensional semidefinite program: 


maximize Tr 


C*C C*D 
D*C D*D 


V 


subject to [I 0] V „ = [A £?] V 


'A* 

B* 


n+ra 


Y 


i=n -\-1 


(6) 


where n is the dimension of the state x, and m is the 
dimension of the disturbance w. The key idea of the proof 
is to construct the sinusoid w that achieves the Hoc norm 
using a rank one solution of the semidefinite program 0. 

In the construction of w, there is no prior structure 
imposed on w. This means that, in general, all m disturbance 
channel are active and must coordinate amongst themselves. 


B. SDP relaxation of k-sparse Boo analysis 

Building on the result of the previous section, we propose 
and analyze a semidefinite relaxation of the optimization 
problem ([3]) that can be used to compute an upper bound 
to the fc-sparse ‘Hoc norm of a system. The relaxation to 
the fc-sparse minimal gain of a system © is analogous, and 
stated without proof. 

To begin with, let us use the matrix 



to, 


as in Boo analysis. For notational convenience, we partition 

V = where X G C nxn , and IF G C mxm . 

R W 

Now we have the following proposition. 


Proposition 1: Card (w) < k if and only if 

Card (diag ( W )) < k. 

Proof: From the definition, Wu = ||wi|||>, where Wu 
is (i, i) entry of IF and w, is the zth component of the vector¬ 
valued signal w. Therefore Card (w) = Card (diag (IF)). 


that achieves the optimal value of the SDP. Similarly, once 
a solution to optimization problem £7} is obtained, we can 
consider a system with disturbance inputs specified by the 
support of the optimal disturbance, and thus apply the 
methods of [8], Thus, the cardinality constrained SDP (0 
is in fact equivalent to fc-sparse Boo optimization 0. 

In applying the techniques from [8], we have re¬ 
duced the optimization problem to a finite dimensional 
semidefinite program with an added cardinality constraint 
Card (diag (IF)) < fc. In order to circumvent the in¬ 
tractability of this constraint, we propose using an i\ re¬ 
laxation [18]. This approach is inspired by [7], in which the 
authors consider the l\ relaxation of an analogous cardinality 
constraint to obtain a semidefinite relaxation of the sparse 
PCA problem, in which one seeks the leading sparse singular 
vector of a matrix (as mentioned previously, this is closely 
related to the RIP constant of a matrix and to analogous 
quantities in RFD). In order to adapt this idea to our problem 
formulation, we need the following observation. 

Proposition 2: Consider W G C nxn such that W A 0, 
TV (IF) < 1. Then, 1 T \W\1 < n. 

Proof: Consider a Hermitian matrix H where 


II, 


1 if i = j 

e l6ij if i f j, 


for some . If we construct H such that Hij = e lZWij , 
then 1 T \W\1 = Tr (H*W). This shows that 1 T \W\1 < 
sup ff Tr (FPIF), and from the Von Neumann’s trace in¬ 
equality [19], we have 


Tr (H*W) <!>(' W)<H), 

i 


where at is the ith singular value of the matrix. Further¬ 
more, by definition of H we have = 

Tr ( H) = n. Therefore, 


Tr (H*W) < 

i i 

< n Tr ( W) < n, 


By applying the same procedure from [8] used to derive 
the SDP used for Boo analysis, we obtain the following 
optimization problem, which provides an upper bound of 0. 


maximize 

-Y.it ,W 


'C*C 

C*D 

D*C 

D*D 

subject to 

* = 

A B] 

'X 

R* 


'X R~\\ 
R* W\) 


R 

W 


A* 

B* 


Tr (IF) < 1 


Card (diag (IF)) < fc 


X 

R* 


R 

IF 


y o. 


(7) 


and C \W\1 < sup ff Tr (H*W) < n. Notice that this 
upper bound is achieved by IF = 111 7 ’, which shows the 
inequality is tight. ■ 

We can now connect the l\ norm bound to the cardinality 
constraint of optimization problem 0. 

Proposition 3: Consider a positive semidefinite matrix IF 
with Tr (IF) < 1 and Card (diag (IF)) < fc. Then, 
1 T |IF|1 < fc. 

Proof: Without loss of generality, we can assume that 
Wu,-- - ,Wu for 1 < * < fc are not zero, where Wu is 
(*,i)th entry of IF. Then from the Schur complement, we 
can easily check that W should have the form 


For the standard Boo problem, this SDP relaxation is 
tight: the proof consists of constructing a disturbance w 


IF = 


IF 

0 ' 

0 

0 




























where W is a i x i Hermitian matrix. Therefore, from 
Proposition [2] l r |PF|l = l r |IV|l < i < fc, which 
concludes the proof. ■ 

In the cardinality constrained problem (0, the W matrix 
satisfies the requirements of Proposition [3] This shows that 
if we replace the cardinality constraint on W in optimization 
problem 0 by a suitable i\ norm bound, then we have 
a larger feasible set. Although this procedure provides an 
upper bound to 0, the resulting optimization becomes a 
semidefinite program, which can be solved efficiently [ 20 ]. 
Therefore, we propose the following i\ based relaxation of 
0 . which is the main optimization problem in this paper. 


{K dp (M )} 2 := 


max 

X,R,W 


s.t. 


Tr 


'c*c 

C*D 


D*C 

D*D 




X = [A B} 

Tr (W) < 1 


' X R 


'A*' 

R* W 


B* 


1 T |IV|1 < fc 


X 

R* 


R 

W 


h 0 . 


In addition, it should be obvious that pk (Ad) < jl s k dp (Ad). 
A careful remark is that for a complex matrix, \W\ should 
be treated as an SOCP, not an LP [21]. 

Although we omit the details, a similar argument for 
continuous time systems yields 


maximize 

X,R,W 

subject to 


Tr 


'C*C 

C*D 


D*C 

D*D 




XA* + AX + R*B* + BR = 0 


Tr (W) < 1 
1 T \W\1 < k 


X 

R* 


R 

W 


h o. 


(9) 


C. Extension to k-sparse minimal gain 

In the previous section, we introduced a fc-sparse minimal 
gain. A similar approach can be used to obtain the following 
SDP relaxation of 0. 


{^(Ad )} 2 := 


min 

X ,R,W 


S.t. 


Tr 


C*C C*D 
D*C D*D 


X = [A B] 
Tr (W) > 1 


l T |kP|l < k 


X 

R* 


R 

W 


y o 


x 

R* 


R 

W 


' X R 


'A*' 

R* W 


B* 


Similarly, for the continuous time case, we have 


minimize 

X,R,W 

subject to 


Tr 


'C*C 

C*D 


D*C 

D*D 




XA* + AX + R*B* +BR = 0 


Tr (IT) > 1 
1 t | 1 T |1 < k 


X 

R* 


R 

W 


y 0 . 


( 10 ) 


D. Rounding heuristic for solution refinement 

Let W* be the optimal solution to optimization problem 
®. Since this matrix contains information about the worst- 
case disturbance, we can extract candidate worst case dis¬ 
turbance channels, and use those to obtain a corresponding 
lower bound to the value of optimization problem 0. The 
approach is simple: identify the top k entries of diag (W ), 
say {Wjjij, Wi 2 i 2 , ■ ■ ■ ,Wi k i k }, and then restrict B and D 
to the column space corresponding to these disturbance 
channels. We can then compute the traditional 7d r)0 norm 
of the system defined by these restricted B and D matrices 
using classical methods. As mentioned, as we are choosing 
specific disturbance channels, this procedure yields a lower 
bound of the fc-sparse norm 0 of a system. The 
procedure can thus be summarized as follows: 

Rounding heuristic: 

1) Solve © to obtain W*. 

2) Find the indices {*!,••• ,ik} such that W i * i > • • • > 

ww >--->w ¥ „. 

3) Construct E := [e^ ••• e* fc ] G ]R rraxfc using a 

standard basis {e^} G R m . 

4) Let B := BE, D = DE, and obtain p r k ound (M) := 
\\B(e ie I — A)~ X C + -D||oo- 

Notice that step 3 chooses ii, - ■ - ik to be the active distur¬ 
bance channels. From this rounding procedure we obtain the 
inequality 

-ro und {M) < flk {M) < jfdv {M) 

Therefore, if the gap between p™ und (A4) and p s k dp (Ad) is 
not large, then p k ound (A4) effectively solves the fc-sparse 
"Hoo problem and returns a candidate set of worst case 
disturbance channels. Notice that this heuristic can also be 
applied to the continuous time case and the minimal gain 
computation, but we omit these details. 


IV. Dual problem & Controller Synthesis 
As optimization problem 0 is an SDP, it is natural to 
consider its Lagrangian dual problem. To do this, let us begin 
with the following observation. 


Proposition 4: For w > 0, A G C, 


sup{— w\x\ + Re (Aa;)} 

xgC 


0 if |A| < w 
4 *oo otherwise 


Proof: Suppose |A| > w. Let x = a\*. Then 
— w\x\ + Re (Ax) = a|A|(|A| — w). 


































By taking a —> oo, we obtain the result. 

Suppose |A| < w. From Cauchy-Schwartz inequality, 

—iu|a;| + Re (As) < —w\x\ + |A||s| < (|A| — w)\x\ < 0, 


for all x £ C. Since the upper bound is achieved by x = 0, 
we can conclude the proof. ■ 

With this technical tool in hand, we may proceed to derive 
the dual to optimization problem ®. First, we form the 

X R 

Lagrangian function in terms of V = ' . 


L(V, P, Q, A, t) 
Tr (QV) + Tr 


(\C*C 

^[p-p 


C*D 

D*D 



+ IV ( P ( [A B]V 


'A* 

B* 


[I 



+A|^l-Tr 
+t ( k — Tr 




where P = P*, Q Y 0, A > 0, t > 0. 

Using cyclic property of the trace operator and 
from Proposition [4] we can obtain the dual function 
d(Q , P, A, t) := sup y= y„ L(V, P, A, t) which becomes A + 
k ■ t when. 


Q + 


C*C 

D*C 


C*D 

D*D - XI 


A* PA — P 

A*PPl 

B*PA 

b*pb\ 


< 


0 

0 


0 

fll T ’ 


( 11 ) 


where the inequality < is a component-wise inequality. In 
addition, d(P, X,t) = +oo if (Q,P, A, t) does not satisfy 
CD- By defining Y = F* to be a right bottom block of 
dTTb . we obtain the following dual program of ®. 


P + C*C -< 0, and this gives a strictly dual feasible point. 
Therefore duality gap is zero. 

Another observation is that if we assume (A, P, C, D) are 
real matrices, then similar argument as in [10] shows that all 
matrices in (ITU can be taken as real matrices. In this case, 
the absolute value constraint becomes —tll T <Y< /ll 7 ’, 
a familiar linear constraint used to impose an element wise 
£i norm bound on a matrix. 

A similar derivation for a continuous time system, ©, 
gives us 


minimize 

p,Y,\t 

subject to 


A T k • t 


A*P + PA PB 
B*P -XI-Y 

C*C C*D 
D*C D*D 

\Y\ < tll T 

P = P*, Y = Y*,t > 0,A > 0, 


A 0 


(13) 


although we omit the detailed derivation. 


A. k-sparse Boo synthesis 

Here we follow the LMI approach to controller syn¬ 
thesis from [22] in order to develop an SDP which designs a 
controller that minimizes the proposed sdp relaxation of k- 
sparse measure. To begin with, consider the dynamical 
system 

x k+ i = Ax k + B iWk + B 2 u k 
z k = C\x k + D uw k + D 12 u k 
y k = C 2 x k + D 21 w k , 

with dynamic controller 

Cfc+i = A K ( k + B K y k 

u k = CxCk + Oxyk- 


minimize 

P,Y,X,t 

subject to 


\ + k -t 

'A* PA - P A*PB 

B*PA B*PB -XI -Y 

'C*C <7* Pi 
+ [D*C d*d\ - U 

\Y\ < tll T 

p = P*,Y = Y*,t> 0, A > 0. 


( 12 ) 


Notice that if we set t = 0, then we recover the SDP 
derived from the KYP lemma which computes the Poo norm 
of the system. It is clear that t = 0 is a suboptimal solution of 
<EJ, and therefore we can easily see that the P*, norm is an 
upper bound of (fl2l > which is consistent with the definition 
of /. -sparse P, M norm. 

In addition, it can be easily checked that the dual problem 
m is strictly feasible when A is stable by setting Y = 0, 
t = 1 and sufficiently large A. With sufficiently large A, only 
left upper block of the LMI constraint becomes relevant, 
and if A is stable, we can find P >~ 0 such that A*PA — 


The synthesis goal is to design Ak, Bk,Ck, Dk which 
minimizes our SDP relaxation of the /--sparse P^ norm, 
®, of the closed loop system: 
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with stable A c i , i.e., p{A c i ) < 1. From this stability re¬ 
quirement, together with Lyapunov stability theorem, we can 
assume that P >- 0 in the LMI in (fl2l >. In addition, we 
assume that the pair (A, B 2 ,C 2 ) are stabilizable, i.e., there 












































exists at least one controller (Ak,Bk,Ck,Dk) such that 
p{A d ) < 1, otherwise there exists no stabilizing controller 
so the controller design problem has no sense. 

Using (A d ,B d , C d , D d ), the matrix inequality constraint 
in the dual of fc-sparse T-Loo analysis, is given by 


A* cl P c iA c i — P c i A* cl P d B d 
B* d P d A d B* cl P c iBd - XI - Y 

_J C* cl C c i C* d D d 1 
+ [D* d C cl D* cl D cl \ ^ 


(14) 


Here we have change the non-strict matrix inequality of 
optimization prpoblem (fl2l > to a strict inequality. Since A d 
is required to be stable, a strictly feasible solution exists 
for a given (A d , B c i,C c i, D c i), and therefore this variation 
does not change the optimal value of the following synthesis 
problem. 


minimize 

Ak Pk ,C k ,D k Pci 

subject to 


X + k ■ t 

m,\Y\<tii T ,P cl yO 
Y = Y*,t> 0, A > 0. 


(15) 


Notice that the above problem is not convex because the 
condition (fl4l > is a bilinear matrix inequality. However be¬ 
cause of its similarity to the standard Hoc synthesis problem, 
optimziation problem (IT5l) can be solved using semidefinite 
programing so long as the order of the controller is taken 
to be greater than or equal to that of the plant. To that end, 
let T = XI + Y, then since T — D* cl D d y 0, T is positive 


definite. With left and right multiplication of 


0 

t -i/2 


to 


(fTTb . we obtain the following equivalent condition of (11 4k 


'A* cl P d A d - P d A^PciBciT- 1 ' 2 
T- 1 l 2 B* l P d A d T-^B^PdBdT- 1 / 2 -1 
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T~ 1 / 2 D* l C a 


C* d D d T-V 2 

T-i/ 2 D* i D d T- 1 / 2 _ 


(16) 


where 
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Range (JV C ) = Ker ( [B* D * 12 ]), N^N C = I 
Range (N a ) = Ker ( [C 2 D 21 \), N* 0 N 0 = I 

After obtaining P, Q by solving the above SDP (fTTb . 


construct P d by P d = 


, where P 2 is given by 


P P* 

[P 2 I 

P — Q~ [ = P 2 P 2 . By applying the Schur complement to 
(Ull, we have 
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(18) 


which is clearly an LMI for a fixed P d . Finally, the following 
optimization returns the controller achieves the optimal value 
of El: 


minimize A + k • t 

Ak ,b k ,c k ,d k 

subject to EJ, |F| < ill T , Y = Y* ( 19 ) 

t > 0, A > 0. 

In summary, two SDPs (fl7T> and (fl9l i are needed to 
construct the controller. The first step is to solve EJ t° 
find P, Q to construct P d , and then solve ( 1 1 9b to find the 
controller (Ak,Bk,CkiDk)- 


V. Numerical examples 

In this section, we demonstrate the usefulness of our 
approach on various types of systems. As will be seen, in 
many cases, the gap between our upper and lower bounds 
is very small, indicating that our relaxations are fairly tight. 
For the optimization, we use CVX [23] with SDPT3 [24]. 


We can immediately see that the above condition is equiv¬ 
alent to the Poo norm of the scaled closed loop sys¬ 
tem, (A d , B d T~ 1 / 2 , C d , D d T~ 1 ^ 2 ), is less than 1 , i.e., 
\\{C d {zI—A d )B d -\-D d )T~ 1 / 2 \\ 00 < 1. Therefore with this 
representation of <IT4b . a simple modification of the classic 
LMI method for M*, synthesis [22] yields the following two 
SDPs which solves EJ when the controller order is taken 
to be greater than equal to the plant order. 


minimize A + k ■ t 
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\Y\ < tll r ,Y = Y*,t > 0, A > 0 


A. A linear chain 

Here we consider a linear chain with 2n + 1 nodes. Each 
subsystem has one internal state, and these states interact 
with adjacent states. We assume that a disturbance can hit 
each state with unity gain, and the performance is the total 
sum of energy in each state. This results in B = /, C = I, 
and D = 0, and A G ]g 2 n+ix 2 n+i ^ as f 0 ji ow j n g form: 

{ al" + i —*1 if i = j 
p if * = j + 1 or i = j - 1 , 

0 otherwise 

where we pick a = 0.8, and p = 0.1. See the Fig. [2] 

Thanks to the system’s symmetry, we can easily obtain 
the A'-sparse ^ maximizing disturbance analytically. The 
(17) solution is to select the center node disturbance channel when 
k = 1, and as k increases, including the right (or left) closest 
node from the center. See Fig.[3]for the result. Here the semi¬ 
definite relaxation provides an upper bound and our rounding 
scheme provides a lower bound. Due to its symmetry, the 
SDP relaxation has a hard time to find the actual solution, 


























Fig. 2: Homogeneous chain with n = 5 


k-Sparse H infinity for a chain 



Fig. 3: SDP, rounding, and true value of fc-sparse 'H-xj 
analysis for a linear chain 


k-Sparse H infinity for a random LTI system 



Fig. 4: Mean values of SDP, rounding, and true value of 
/c-sparse analysis for random LTI systems 



k-Sparse H infinity for Petersen graph with a max degree rule 



Fig. 6: SDP, and rounding value of fc-sparse H- Xj analysis 
for the Petersen synchronization network with the maximum 
degree rule 


but interestingly enough, our rounding scheme returns the 
true optimal value. We also compute the Boo norm of the 
system, and the ratio between 1-sparse norm and 'H- x _ norm 
is around 0.85. 

B. Random dynamical system 

For this example, we construct an Erdos-Renyi graph with 


D. k-sparse Boo synthesis 

To illustrate the effectiveness of our synthesis approach, 
we apply our method to the following system: 


A = 


(n,p). The weight of each edge is drawn from the standard 
Normal distribution to construct A. Here, B = 0.1 I n , C = 

Ci = 

h ' 

^3x3 

, D 11 = 06x6) 
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. J 3 . 

I n , and D = 0. 

C2 = I 3 , D 21 = [03x3 h] 
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Bi = [h O3X3] , B 2 = I3 


After obtaining values of 20 samples, we plot the mean 
of the upper bound and the lower bound. See Fig. 0] We 
also perform exhaustive searches up to k = 5 to find the 
true optimal value. In this case, we can see that the exact 
solution has matched with our rounding scheme. 

C. Synchronization network 

To construct the example of a synchronization network, 
we choose the Petersen graph for the graph topology. 

Based on this topology, we generate two synchronization 
networks. The first one is based on the maximum degree rule, 
and the second one is based on the fastest protocol synthesis 
method via semidefinite programming [14]. See Fig. [6] and 
[7] for the result. 


Based on our approach, we obtain the controller that min¬ 
imizes the SDP relaxation of the fc-sparse Boo norm using 
convex optimization. Then we compute the actual fc-sparse 
RLoo norm via exhaustive search to compare the results, see 
the Table U for the result. 

Since our synthesis method is based on the SDP relaxation 
of the fc-sparse Boo norm, the resulting controller may not 
be the true optimal controller. However, as we can see, the 
controllers computed with respect to relaxations of the k- 
sparse 1 -Loo norm exhibit better performance with respect to 
k disturbances than the general B- x optimal controller. In 
particular, if only k disturbances are allowed to coordinate 
their attack, then we see that if a controller is designed 









































k-Sparse H infinity for Petersen graph with an FDLA 



Fig. 7: SDP, and rounding value of fc-sparse 77 oo analysis 
for the Petersen synchronization network with the maximum 
spectral gap 


fc-sparse 

controller 

1 

fc-sparse TLoo norm 

2 3 

Hoo 

i 

1.1826 

1.3939 

1.5078 

1.7152 

2 

1.2289 

1.3340 

1.4116 

1.5258 

3 

1.2509 

1.3539 

1.4053 

1.5159 

77 oc 

1.3832 

1.4172 

1.4389 

1.5050 


TABLE I: fc-sparse 77^ norms of the controller obtained 
from our method. The minimum values in the rows are 
emphasized. 


to mitigate the worst case effect of a larger number of 
disturbances, this can in fact lead to a degradation in the 
closed loop /.-spare 77oo norm of the system. 

VI. Conclusion 

Motivated by robustness properties of large-scale systems, 
we defined the fc-sparse 77oo norm and the fc-sparse minimal 
gain of a system, and argued that in such large-scale settings, 
traditional 77oo analysis may be overly conservative. As 
computing these objects involves solving a combinatorial op¬ 
timization problem, we developed semidefinite programming 
relaxations to these combinatorial optimization problems, 
akin to those used by [7] in the context of sPCA, leading to 
upper (lower) bounds on the fc-sparse 77oo norm (minimal 
gain) of a system. We also developed a simple rounding 
heuristic to provide corresponding lower (upper) bounds. 
Via numerical simulation, we show that the gap between 
the upper bound and the lower bounds obtained is usually 
quite small, and that perhaps surprisingly, the candidate 
disturbance that achieves the lower bound is indeed the 
true worst-case sparse disturbance. We also developed a 
centralized controller synthesis method based on the KYP- 
like dual of our semidefinite relaxation, and confirmed its 
effectiveness through a numerical example. In future work, 
we aim to extend our synthesis methods to nested distributed 
systems [25] (which also admit solutions based on KYP-like 
semidefinite programs), and to develop specialized solvers 
that exploit structure in the state-space parameters such that 
our methods can scale to systems with hundreds to thousands 
of states. 
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